Statistics of spike trains in conductance-based neural net- 
works: Rigorous results. 
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Abstract 



We consider a conductance based neural network inspired by the generalized Integrate and Fire model 

. introduced by Rudolph and Destexhe in [IJ. We show the existence and uniqueness of a unique Gibbs 

' distribution characterizing spike train statistics. The corresponding Gibbs potential is explicitly computed. These 

G^ ' 

results hold in presence of a time-dependent stimulus and apply therefore to non-stationary dynamics. 

o 



_Cy_' 1 Introduction 

Neural networks have an overwhelming complexity. While an isolated neuron can exhibit a wide variety of 
responses to stimuli [2, , from regular spiking to chaos [3l[4] , neurons coupled in a network via synapses 
(electrical or chemical) may show an even wider variety of collective dynamics [5] resulting from the 
conjunction of nonlinear effects, time propagation delays, synaptic noise, synaptic plasticity, and external 
stimuli \E' . Focusing on the action potentials, this complexity is manifested by drastic changes in the spikes 
activity, for instance when switching from spontaneous to evoked activity (see for example A. Richie's team 
experiments on the monkey motor cortex [THlOj). However, beyond this complexity may exist some hidden 
laws ruling an (hypothetical) "neural code" [llj . 
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One way of unraveling these hidden laws is to seek some regularities or reproducibility in the statistics of 
spikes. While early investigations on spiking activities were focusing on firing rates where neurons are 
considered as independent sources, researchers concentrated more recently on collective statistical 
indicators such as pairwise correlations. Thorough experiments in the retina jl2lll3j as well as in the 
parietal cat cortex [14 , suggested that such correlations are crucial for understanding spiking activity. 
Those conclusions where obtained using the maximal entropy principle [15_. Assume that the average value 
of observables quantities (e.g. firing rate or spike correlations) has been measured. Those average values 
constitute constraints for the statistical model. In the maximal entropy principle, assuming stationarity, 
one looks for the probability distribution which maximizes the statistical entropy given those constraints. 
This leads to a (time-translation invariant) Gibbs distribution. In particular, fixing firing rates and the 
probability of pairwise coincidences of spikes leads to a Gibbs distribution having the same form as the 
Ising model. This idea has been introduced by Schneidman et al in [12 for the analysis of retina spike 
trains. They reproduce accurately the probability of spatial spiking pattern. Since then, their approach has 
known a great success (see e.g. [I6l - [T8] ). although some authors raised solid objections on this 
model |13lll9f[2T| while several papers have pointed out the importance of temporal patterns of activity at 
the network level p2H24] . As a consequence, a few authors [14l[25l[26] have attempted to define 
time-dependent models of Gibbs distributions where constraints include time-dependent correlations 
between pairs, triplets and so on [27]. As a matter of fact, the analysis of the data of 12 with such models 
describes more accurately the statistics of spatio-temporal spike patterns |28j . 

Taking into account all constraints inherent to experiments it seems extremely difficult to find an optimal 
model describing spike trains statistics. It is in fact likely that there is not one model, but many, 
depending on the experiment, the stimulus, the investigated part of the nervous system and so on. 
Additionally, the assumptions made in the works quoted above are difficult to control. Especially, the 
maximal entropy principle assumes a stationary dynamics while many experiments consider a 
time-dependent stimulus generating a time-dependent response where the stationary approximation may 
not be valid. At this stage, having an example where one knows the explicit form of the spike trains 
probability distribution would be helpful to control those assumptions and to define related experiments. 
This can be done considering neural network models. Although, to be tractable, such models may be quite 
away from biological plausibility, they can give hints on which statistics can be expected in real neural 
networks. But, even in the simplest examples, characterizing spike statistics arising from the conjunction of 
nonlinear effects, time propagation delays, synaptic noise, synaptic plasticity, and external stimuli is far 
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from being trivial on mathematical grounds. 

In [29| we have nevertheless proposed an exact and explicit result for the characterization of spike trains 
statistics in a discrete time version of Leaky Integrate-and-Fire neural network. The results were quite 
surprising. It has been shown that whatever the parameters value (in particular synaptic weights) , spike 
trains are distributed according to a Gibbs distribution whose potential can be explicitly computed. The 
first surprise lies in the fact that this potential has infinite range, namely spike statistics has an infinite 
memory. This is because the membrane potential evolution integrates its past values and the past infiuence 
of the network via the leak term. Although Leaky Integrate-and-Fire models have a reset mechanism which 
erases the memory of the neuron whenever it spikes, it is not possible to upper bound the next time of 
firing. As a consequence, statistics is non-Markovian (for recent examples of non-Markovian behavior in 
neural models see also 00] ). The infinite range of the potential corresponds, in the maximal entropy 
principle interpretation, to having infinitely many constraints. 

Nevertheless, the leak term influence decays exponentially fast with time (this property guarantees the 
existence and uniqueness of a Gibbs distribution). As a consequence, one can approximate the exact Gibbs 
distribution by the invariant probability of a Markov chain, with a memory depth proportional to the log 
of the (discrete time) leak term. In this way, the truncated potential corresponds to a finite number of 
constraints in the maximal entropy principle interpretation. However, the second surprise is that this 
approximated potential is nevertheless far from the Ising model or any of the models discussed above, that 
appear as quite bad approximations. In particular, there is a need to consider n-uplets of spikes with time 
delays. This mere fact asks hard problems about evidencing such type of potentials in experiments. 
Especially, new type of algorithms for spike trains analysis have to be developed |31] . 
The model considered in |29| is rather academic: time evolution is discrete, synaptic interactions are 
instantaneous, dynamics is stationary (the stimulus is time-constant) and, as in a Leaky Integrate-and-Fire 
model, conductances are constant. It is therefore necessary to investigate whether our conclusions remain 
for more realistic neural networks models. In the present paper we consider a conductance-based model 
introduced by Rudolph and Destexhe in U called "generalized Integrate and Fire" (gIF) model. This 
model allows one to consider realistic synaptic responses, and conductances depending on spikes arising in 
the past of the network, leading to a rather complex dynamics which has been characterized in [32] in the 
deterministic case (no noise in the dynamics). Moreover, the biological plausibility of this model is well 
accepted [551151] . 

Here we analyse spike statistics in the gIF model with noise and with a time-dependent stimulus. 
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Moreover, the post-synaptic potential profiles are quite general and summarize all the examples that we 
know in the literature. Our main result is to prove the existence and uniqueness of a Gibbs measure 
characterizing spike trains statistics, for all parameters compatible with physical constraints (finite synaptic 
weights, bounded stimulus, and positive conductances). Here, as in [29], the corresponding Gibbs potential 
has infinite range corresponding to a non-Markovian dynamics, although Markovian approximations can be 
proposed in the gIF model too. The Gibbs potential depends on all parameters in the model (especially 
connectivity and stimulus) and has a form quite more complex than Ising-like models. As a by-product of 
the proof of our main result, additional interesting notions and results are produced such as continuity 
with respect to a raster, or exponential decay of memory thanks to the shape of synaptic responses. 
The paper is organised as follows. In the section [2] we briefiy introduce Integrate-and-Fire models and 
propose two important extensions of the classical models: the spike has a duration and the membrane 
potential is reset to a non-constant value. These extensions, which are necessary for the validity of our 
mathematical results, render nevertheless the model more biologically plausible (see the discussion section). 
One of the keys of the present work is to consider spike trains (raster plots) as infinite sequences. Since in 
gIF models conductances are updated upon the occurrence of spikes, one has to consider two types of 
variables with distinct type of dynamics. On one hand, the membrane potential, which is the physical 
variable associated with neurons dynamics evolves continuously. On the other hand, spikes are discrete 
events. Conductances are updated according to these discrete time events. The formalism introduced in 
section [2] and [3] allows us to handle properly this mixed dynamics. As a consequence, these sections define 
gIF model with more mathematical structure than the original paper [T] and mostly contain original 
results. Moreover, we add to the model several original features such as the consideration of a general form 
of synaptic profile with exponential decay or the introduction of noise. Section 2] proposes a preliminary 
analysis of gIF model-dynamics. In sections [SJ IHl we provide several useful mathematical propositions as a 
necessary step toward the analysis of spike statistics, developed in section [71 where we prove the main 
result of the paper: existence and uniqueness of a Gibbs distribution describing spike statistics. The 
section [S] and [HI are devoted to a discussion on practical consequences of our results for neuroscience. 

2 Integrate and Fire model. 

We consider the evolution of a set of N neurons. Here, neurons are considered as "points" instead of 
spatially extended and structured objects. As a consequence, we define, for each neuron k E {1 . . .N}, a 
variable Vk {t) called the "membrane potential of neuron k at time i" without specification of which part of 
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a real neuron (axon, soma, dendritic spine, ...) it corresponds to. Denote V{t) the vector ( Vk{t) 
We focus here on "Integrate-and-Fire models" , where dynamics always consists of two regimes. 

2.1 The "Integrate regime". 



Fix a real number 9 called the "firing threshold of the neuron"|^. Below the threshold, Vk < 9, neuron fc's 
dynamics is driven by an equation of the form: 

Ck^^ + gkVk ^ ik, (1) 

where Ck is the membrane capacity of neuron k. In its most general form, the neuron fc's membrane 
conductance gk > depends on Vk plus additional variables such as the probability of having ionic 
channels open (see e.g. Ho dgkin- Huxley equations |35j ) as well as on time t. The explicit form of gk in the 
present model is developed in section [3.41 The current ik typically depend on time t, and on the past 
activity of the network. It also contains a stochastic component modelling noise in the system (e.g. 
synaptic transmission, see section [33]) . 



2.2 LIF model 

A classical example of Integrate-and-Fire model is the Leaky Integrate-and-Fire's (LIF) introduced in [42] 
where equation ([IJ reads: 

dVk ^ Vk , zfc(t) ^2) 



dt tl Ck 



where gk is a constant and = ^ is the characteristic time for membrane potential decay when no 
current is present ( "leak term" ) . 



2.3 Spikes 

The dynamical evolution ([iJ may eventually lead Vk to exceed 9. If, at some time t, Vk{t) — 9 then neuron 
k emits a spike or "fires" . In our model, like in biophysics, a spike has a finite duration (5 > 0; this is a 
generalisation of the classical formulation of Integrate-and-Fire models where the spike is considered 
instantaneous. On biophysical grounds 5 is of order of a millisecond. Changing the time units we may set 

^We assume that all neurons have the same firing threshold. The notion of threshold is already an approximation which 
is not sharply defined in Hodgkin-Huxley |35| or Fitzhugh-Nagumo |36II37| models (more precisely it is not a constant but 
it depends on the dynamical variables 1381 ). Recent experiments | 39H41| even suggest that there may be no real potential 
threshold. 
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5—1 without loss of generahty. Additionally, neurons have a refractory period T^e/r > where they are 
not able to emit a new spike although their membrane potential can fluctuate below the threshold (see fig. 
[T]). Hence, spikes emitted by a given neuron are separated by a minimal time scale 



2.4 Raster plots 

In experiments spiking neurons activity is represented by "raster plots" , namely a graph with time in 
abscissa and a neuron labeling in ordinate such that a vertical bar is drawn each "time" a neuron emits a 
spike. Since spikes have a finite duration 6 such a representation limits the time resolution: events with a 
time scale smaller that 6 are not distinguished. As a consequence, if neuron 1 fires at time ti and neuron 2 
at time t2 with | i2 ~ | < 5 = I the two spikes appear to be simultaneous on the raster. Thus, the raster 
representation introduces a time quantization and has a tendency to enhance synchronization. In gIF 
models conductances are updated upon the occurrence of spikes (see section [3. 2p which are considered as 
such discrete events. This could correspond to the following "experiment" . Assume that we measure the 
spikes emitted by a set of in vitro neurons, and that we use this information to update the conductances of 
a model, in order to see how this model "matches" the real neurons (see [58] for a nice investigation in this 
spirit). Then, we would have to take into account that the information provided by the experimental raster 
plot is discrete, even if the membrane potential evolves continuously. The consequences of this 
time-discretisation as well as the limit (5 — > are developed in the discussion section. 

As a consequence, one has to consider two types of variables with distinct type of dynamics. On one hand, 
the membrane potential, which is the physical variable associated with neuron dynamics evolves with a 
continuous time. On the other hand, spikes, which are the quantities of interest in the present paper are 
discrete events. To define properly this mixed dynamics and study its properties we have to model spikes 
times and raster plots. 

2.5 Spike times 

If, at time t, Vk{t) = 9, a, spike is registered at the integer time immediately after t, called the spike time. 
Choosing integers for the spike time occurrence is a direct consequence of setting 6=1. Thus, to each 
neuron k and integer n we associate a "spiking state" defined by: 



T, 




(3) 




if 3te]n-l,n] such that Vk{t) = 9; 



otherwise. 
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For convenience and in order to simplify the notations in the mathematical developments, we call [t] the 
largest integer which is < t (thus [—1.2] = —2 and [1.2] = 1). Thus, the integer immediately after t is 
[t + 1 ] and we have therefore that + 1 ]) = 1 whenever Vk{t) — 9. Although, characteristic events in a 

raster plot are spikes (neuron fires) it is useful in subsequent developments to consider also the case when 
neuron is not firing {ujk{n) = 0). 

2.6 Reset 

In the classical formulation of Integrate-and-Fire models the spike occurs simultaneously with a reset of the 
membrane potential to some constant value Vreset j called the "reset potential" . Instantaneous reset is a 
source of pathologies as discussed in and in the discussion section. Here, we consider that reset 

occurs after the time delay Tg^p > 1 including spike duration and refractory period. We set: 

Vk{t)=e^Vk{[t + Tsep]) = Vre.et. (4) 

The reason why the reset time is the integer number [ t + r^ep ] instead of the real t + r^ep is that it eases 
the notations and proofs. Since the reset value is random (see below and Fig. [T]) this assumption has no 
impact on the dynamics. 

Indeed, in our model, the reset value Vreset is not a constant. This is a Gaussian random variable with 
mean zero (we set the rest potential to zero without loss of generality) and variance cr^ > 0. In this way we 
model the spike duration and refractory period, as well as the random oscillations of the membrane 
potential during the refractory period. As a consequence, the value of Vk when the neuron can fire again is 
not a constant, as it is in classical IF models. A related reference (spiking neurons with partial reset) 
is [33]. The assumption that cr^ > is necessary for our mathematical developments (see the bounds ([57]) '). 
We assume to be small to avoid trivial and unrealistic situations where Vreset > with a large 
probability leading the neuron to fire all the time. Note however that this is not a required assumption to 
establish our mathematical results. We also assume that, in successive resets, the random variables Vreset 
are independent. 

2.7 The shape of membrane potential during the spike 

On biophysical grounds the time course of the membrane potential during the spike includes a 
depolarisation and re-polarisation phase due to the nonlinear effects of gated ionic channels on the 
conductance. This leads to introduce, in modelling, additional variables such as activation/inactivation 
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probabilities as in the Hodgkin-Huxley model |35[ or adaptation current as e.g. in FitzHugh-Nagumo 
model [5511571 (see the discussion section for extensions of our results to those models). Here, since 
we are considering only one variable for the neuron state, the membrane potential, we need to define the 
spike profile, i.e. the course of Vk{t) during the time interval {t,[t + Tsep])- It turns out that the precise 
shape of this profile plays no role in the developments proposed here, where we concentrate on spike 
statistics. Indeed, a spike is registered whenever Vk{t) — 9 and this does not depend on the spike shape. 
What we need is therefore to define the membrane potential evolution before the spike, given by ([Ij, and 
after the spike, given by dU (see Figure [TJ. 
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Figure 1: Time course of the membrane potential in our model. The blue dashed curve illustrates the shape 
of a real spike, but what we model is the red curve. 



2.8 Mathematical representation of raster plots 

The "spiking pattern" of the neural network at integer time n is the vector w(?i) — (wfc(n))^-^. For m < n 
we note cjj^ — { uj{m) uj(m + 1) . . . io{n) } the ordered sequence of spiking patterns between m and n. Such 
sequences are called spike blocks. Additionally we note lu^I^^uj".^ = the concatenation of the blocks 
ujli^-'^ and 

Call ^ = { 0, 1 }^ the set of spiking patterns (alphabet). An element of X =^ A'^, i.e. a bi- infinite ordered 
sequence uj — {^^{n)}^^_^ of spiking patterns, is called a "raster plot". It tells us which neurons are firing 
at each time n G Z. In experiments raster plots are obviously finite sequences of spiking pattern but the 
extension to especially the possibility of considering an arbitrary distant past (negative times) is a key 
of the present work. In particular, the notation ujI^ refers to spikes occurring from — oo to n. 
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To each raster w € X and each neuron inde^o j = 1 . . . iV we associate an ordered (generically infinite) list 

of "spike times" \ t^piu) \ (integer numbers) such that t'f\bj) is the r-th time of firing of neuron j in 
L ^ J r=i ■' 

the raster uj. In other words, we have ujj{n) = 1 if and only if n = t^p{uj) for some r = 1, • • • + oo. 
We introduce here two specific rasters which are of use in the paper. We note fio the raster such that 
Wfc(?^) = 0, Vfc = 1 . . .N,yn G Wj (no neuron ever fires) and fli the raster ujk{n) = 1, Vi — 1 . . .N,yn G Z 
(each neuron is firing at every integer time). 

Finally, we use the following notation borrowed from [47] . We note, for n G m > 0, and r integer: 

w w' if aj(r) = a;'(r), Vr G { n — m, . . . , n } . (5) 

For simplicity, we consider that T^e/, the refractory period, is smaller than 1 so that a neuron can fire two 
consecutive time steps (i.e. one can have Wfe(n) = 1 and ujkin + 1) = 1). This constraint is discussed in 
section 19.21 

2.9 Representation of time dependent functions 

Throughout the paper we use the following convention. For a real function of t and oj, we write f{t,uj) for 
/(t,cjL*c|o) to simplify notations. This notation takes into account the duality between variables such as 
membrane potential evolving with respect to a continuous time and raster plots labeled with discrete time. 
Thus, the function f(t, uj) is a function of the continuous variable t and of the spike block wL'j^j where by 
definition [t] <t, namely f(t,uj) depends on the spike sequences occurring before t. This constraint is 
imposed by causality. 

2.10 Last reset time 

We define Tk{t^uj) as the last time before t where neuron fc's membrane potential has been reset, in the 
raster w. This is —oo if the membrane potential has never been reset. As a consequence of our choice Q 
for the reset time Tk{t,uj) is an integer number fixed by t and the raster before t . The membrane potential 
value of neuron k at time t is controlled by the reset value Vj-eset at time Tk{t,uj) and by the further 
sub-threshold evolution ([T]) from time Tk{t,ijj) to time t. 

■^We use the following convention. The index k is used for a post-synaptic neuron while the index j refers to pre-synaptic 
neurons. Spiking events are used to update the conductance of neuron k according to spikes emitted by pre-synaptic neurons. 
That's why we label the spike times with an index j. 
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3 Generalized Integrate-and-Fire models 

In this paper, we concentrate on an extension of ([2]), called "generalized Integrate-and-Fire" (gIF), 
introduced in 1 , closer to biology [331134] . since it considers more seriously neurons interactions via 
synaptic responses. 

3.1 Synaptic conductances 

Depending on the neuro-transmitteiy they use for synaptic transmission neurons can be excitatory 
(population £) or inhibitory (population T). This is modeled by introducing reversal potentials for 
excitatory (typically E+ ~ OmV for AMPA and NMDA) and for inhibitory {E^ ~ -70mV for GABA 
A and E^ ~ —95mV for GABA B). We focus here on one population of excitatory and one population of 
inhibitory neurons although extensions to several populations may be considered as well. Also, each neuron 
is submitted to a current Ik{t). We assume that this current has some stochastic component that mimics 
synaptic noise (section [33)) . 

The variation of the membrane potential of neuron k at time t reads: 



where gL,k is a leak conductance. El < is the leak reversal potential (about —65 mV), gj. (t) the 

(X) 

conductance of the excitatory population and gf. (t) the conductance of inhibitory population. They are 
given by: 



Cfc — ^ = -gLM {Vk ~ El) - grU) {V^ - E+) - gf\t) {Vu E') + h{t), 



(6) 




(7) 



3^£ 



where gkj is the conductance of the synaptic contact j ^ k. 
We may rewrite equation © in the form ([1]) setting 



9k{t)^gL,k + gi\t) + g[^\t) 



and 



ik{t) = gL,kEL + gl 



{t)E++gf\t)E- +h{t). 



3AMPA, NMDA, GABA A, GABA B [48]. 
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3.2 Conductance update upon a spike occurrence. 

The conductances gkj{t) in Q depend on time t but also on pre-synaptic spikes occurring before t. This is 
a general statement which is modeled in gIF models as follows. Upon arrival ol a spike in the pre-synaptic 
neuron j at time t^p (w) the membrane conductance of the post-synaptic neuron k is modified as: 

9k, (t) = Qk, (tf (^)) + Gk, at, ( t - (c.) ) , t> (lu) . (8) 

In this equation, the quantity Gkj > characterizes the maximal amplitude of the conductance during a 
post-synaptic potential. We use the convention that Gkj = if and only if there is no synapse between j 
and k. This allows us to encode the graph structure of the neural network in the matrix G with entries 
Gkj- Note that the Gkj^s can evolve in time due to synaptic plasticity mechanisms (see section [9. 4p . 
The function akj (called "alpha" profile 48 ) mimics the time course of the synaptic conductance upon the 
occurrence of the spike. Classical examples are: 

akj{t)^e'^ H{t), (9) 

(exponential profile) or: 

akj{t)^ —e'^ H{t), (10) 

with H the Heaviside function (that mimics causality) and Tkj is the characteristic decay times of the 
synaptic response. Since t is a time, the division by Tkj ensures that akj (t) is a dimensionless quantity: 
this eases the legibility of the subsequent equations on physical grounds (dimensionality of physical 
quantities). 

Contrarily to © the synaptic profile (jlOp . with akj ( ) = while akj (t) is maximal for t — Tkj allows one 
to smoothly delay the spike action on the post-synaptic neuron. More general forms of synaptic responses 
could be considered as wellQ. 

3.3 Mathematical constraints on the synaptic responses 

In all the paper we assume that the a^j's are positive and bounded. Moreover, we assume that: 

akj{t) j-e ^ fkj{t), t^+oo, (11) 

'^kj 



For example, the a profile may obey a Green equation of type |49j : 



1=0 



where fe = 1, a^^j = cij}^^ = 1, corresponds to ((Qj, and so on. 
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for some integer d. So that akj (t) decays exponentially fast as t — s- +00, with a characteristic time Tkj, 
the decay time of the evoked post-synaptic potential. This constraint matches all synaptic response kernels 
that we know (where typically d = 0,1) 481149] . 

This has the following consequence. For all t, M < t integer, r integer, we have, setting t — {t} + [t], 
where {t} is the fractional part: 

Y^akjit-r)^Y.'^kj{[t]-r + {t})^ ^ afc, ( n + { i } ) ■ 

r<M r<M n>[t]-M 

Therefore, as — > — co, 

22c^kj{t-r)^ fkj{n + {t})< fkjiu)du^Pd[ e "''^ , 

r<M n>[t]-M+l ^ ^ 

where is a polynomial of degree d. 

We introduce the following (Hardy) notation: if a function f{t) is bounded from above, as t — > +00, by a 
function git) we write: f{t) < git)- Using this notation we have therefore: 



Proposition 1 

V akAt-r)^Pdi- 



^ if— ]\/J \ _ t-M 

Y,akj{t-r)^Pd[ e , (12) 



r<M 

as M ^ —00. 

Additionally, the constraint pT|) implies that there is some a+ < +00 such that, for all t, for all k,j: 

Y,akj{t-r)<a+. (13) 

r<t 

Indeed, for n > integer, call Akj (n) — sup { atj {n + x) ; x G [0, 1 [}. Then, 

+00 +00 
J2^kjit-r) = Yakjin + {t}) <J2^k3in). 

r<t n=l n=l 

Due to (fTTj) this series converges (e.g. from Cauchy criterion). We set: 

+ C30 

a+ — max A^j (n). 

kj 

n—1 

On physical grounds it implies that the conductance gk remains bounded, even if each pre-synaptic neuron 
is firing all the time (see eq. ([23) below). 

3.4 Synaptic summation 

Assume that eq. (jS]) remains valid for an arbitrary number of pre-synaptic spikes emitted by neuron j 
within a finite time interval [s,t] (i.e. neglecting nonlinear effects such as the fact that there is a finite 
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amount of neurotransmitter leading to saturation effects) . Then, one obtains the following equation for the 
conductance g^.j at time t, upon the arrival of spikes at times t'j'\uj) in the time interval [s,t\: 

9k]{t) = gkj{s) + Gkj ^ akj {^t - t'f\uj) ^ . 

{r;s<t<"'(cj)<t} 

The conductance at time s, gkj{s), depends on the neuron j's activity preceding s. This term is therefore 
unknown unless one knows exactly the past evolution before s. One way to circumvent this problem is to 
taking s arbitrary far in the past, i.e. taking s — > — oo in order to remove the dependence on initial 
conditions. This corresponds to the following situation. When one observes a real neural network the time 
where the observation starts, say t = 0, is usually not the time when the system has begun to exist, s in 
our notations. Taking s arbitrary far in the past corresponds to assuming that the system has evolved long 
enough so that it has reached sort of a "permanent regime" , not necessarily stationary, when the 
observation starts. On phenomenological grounds it is enough to take —s larger than all characteristic 
relaxation times in the system (e.g. leak rate and synaptic decay rate). Here, for mathematical purposes it 
is easier to take the limit s — > —oo. 

Since gkj{t) depends on the raster plot up to time t, via the spiking times t^^\io) this limit makes only 
sense when taking it "conditionally" to a prescribed raster plot uj. In other words, one can know the value 
of the conductances gkj at time t only if the past spike times of the network are known. We write gkj{t,Ljj) 
from now on to make this dependence explicit. 
We set 

akj {t,uj) = ^ hrn^ "fcJ- ( ^ - 4'^ (^) ) = ( * - ) ' (14) 

{r;s<t<'''(w)<t} { r;t<"'(w)<t} 

with the convention that ^0 = so that a^j ( fip ) =0 (recall that i7o is the raster such that no neuron 
ever fires). The limit exists from ([T^. 

3.5 Noise 

We allow, in the definition of the current Ik{t) in eq. ([5]) the possibility of having a stochastic term 
corresponding to noise so that: 

h{t) = tt'\t) + asUt), (15) 

where i[f {t) is a deterministic external current and S^u (t) a noise term whose amplitude is controlled by 
ctb > 0. The model affords an extension where as depends on k but this extension is straightforward and 
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we do not develop it here. The noise term can be interpreted as the random variation in the ionic flux of 
charges crossing the membrane per unit time at the post synaptic button, upon opening of ionic channels 
due to the binding of neurotransmitter. 

We assume that ^fe(i) is a white noise, Cfc(i) = where dBk{t) is a Wiener process, so that 

dB{t) ~ {dBk{t) is a A^-dimensional Wiener process. Call P the noise probability distribution and 

E [ ] the expectation under P. Then, by definition, E[dBk{t) ] = 0, Vfc = 1 . . . A^, i e R, and 

E [dBk{s) dBi{t) ] — 5ki S{t — s)dt where 5ki — I ii I ^ k, I, k ^ 1 . . . N and S{t — s) is the Dirac distribution. 

3.6 Differential equation for the Integrate regime of gIF 

Summarizing, we write eq. ([B]) in the form: 

Ck'^ + 9kit,u})Vk = ikit,uj), (16) 
dt 

where: 

N 

9k{t,uj) ^ gL,k + ^ Gkjakj ( i, w ) . (17) 

This is the more general conductance form considered in this paper. 
Moreover, : 

N 

ik{t,uj)^gL^kEL+ J2Wkjakj{t,uj) + ^[,'"*^(^) + (JB^k{t), (18) 
i=i 

where Wkj is the synaptic weight: 

Wkj=E+Gkj, if je£, 
Wkj=E-Gkj. if jel. 

These equations hold when the membrane potential is below the threshold (Integrate regime). 
Therefore, gIF models constitute rather complex dynamical systems: the vector field (r.h.s) of the 
differential equation (I16|) depends on an auxiliary "variable" which is the past spike sequence a;L*Jo and to 
define properly the evolution of Vk from time t to later times one needs to know the spikes arising before t. 
This is precisely what makes gIF models more interesting than LIF. The definition of conductances 
introduces long term memory effects. 

IF models implement a reset mechanism on the membrane potential: If neuron k has been reset between s 
and t, say at time r, then Vk{t) depends only on Vfc(T) and not on previous values, as in But, in gIF 
model, contrarily to LIF, there is also a dependence in the past via the conductance and this dependence is 
not erased by the reset. That's why we have to consider a system with infinite memory. 
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3.7 The parameters space 

The stochastic dynamical system (jl6p depends on a huge set of parameters: the membrane capacities 
Ck, k = 1 . . . N, the threshold 9, the reversal potentials El, , E^ , the leak conductance g^; the maximal 
synaptic conductances Gkj, k,j — I . . .N which define the neural network topology; the characteristic 
times Tkj, k, j = 1 . . . N of synaptic responses decay; the noise amplitude and, additionally, the 
parameters defining the external current Although some parameters can be fixed from biology, such 

as Ck, the reversal potentials, r^j, ... some others such as the Gkj^s must be allowed to vary freely in order 
to leave open the possibility of modelling very different neural networks structures. 

In this paper we are not interested in describing properties arising for specific values of those parameters, 
but instead in generic properties that hold on sets of parameters. More specifically, we denote the list of all 
parameters ( Ck , El, E^ , E^ , ( Gkj )kj=i ' ■ ■ • ) ^^'^ symbol 7. This is a vector in where K is 
the total number of parameters. In this paper, we assume that 7 belongs to a bounded subset H C R^. 
Basically, we want to avoid situations where some parameters become infinite, which would be unphysical. 
So the limits of H are the limits imposed by biophysics. Additionally, we assume that aji > and ctb > 0. 
Together with physical constraints such as "conductances are positive" , these are the only assumption 
made in parameters. All mathematical results stated in the paper old for any 7 S 

4 gIF model-dynamics for a fixed raster 

We assume that the raster lu is fixed, namely the spike history is given. Then, it is possible to integrate the 
equation (jl6p (Integrate regime) and to obtain explicitly the value of the membrane potential of a neuron 
at time t, given the membrane potential value at time s. Additionally, the reset condition Q has the 
consequence of removing the dependence of neuron k on the past anterior to Tk{t,uj). 



4.1 Integrate regime 

For h < t2, ti,t2 e R, set: 

rfe(ti,i2,w) =e"^^*'' ^'■^ (19) 

We have: 

Tk{ti,ti,LL>) = Tkit2,t2,Uj) = 1, 

and: 

drk{ti,t2,uj) gk{ti,uj) 

N[ = rk{h,t2,u:). 
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Fix two times s < t and assume that for neuron fc, Vk(u) <9,s<u<t so that the membrane potential Vk 
obeys dH]). Then: 



dVk gkiti,uj) ^ 



We have then, integrating the previous equation with respect to ti between s and and setting t2 — t: 

1 /■* 

Vk{t) ^Tk{s,t,uj)Vk{s) + J ^k{ti,t,uj)ik{ti,uj)dti. 

This equation gives the variation of membrane potential during a period of rest (no spike) of the neuron. 
Note however that this neuron can still receive spikes from the other neurons via the update of 
conductances (made explicit in the previous equation by the dependence in the raster plot w). 
The term Tk{s, t, uj) given by (fTO)) is an effective leak between s, t. In the Leaky Integrate and Fire model it 
would have been equal to e ^ — e . The term: 

def 1 /"* 

Vk{s,t,uj) = — / Tk{ti,t,u})ikiti,uj)dti, 



Ck 

has the dimension of a voltage. It corresponds to the integration of the total current between s and t 
weighted by the effective leak term Tk{ti,t,Lu). It decomposes as 

Vk{s,t,u:)^vi'y"\s,t,u:) + vt'\s,t,L.) + vf H.,t,c.), 

where, 

vi'^''\s,t,Lo) ^ —Y^Wkj j Tk{tut,uj)akj{h,uj)dh, (20) 



is the synaptic contribution. Moreover, 



where we set: 



V^'^"*'(s,t,c.) = ^ / Tk{h,t,uj)dt, + ^ f ti'^'\h)rk{tut,io)dt, 

TL,k Js L-fe Js 



dcf Ck , ^ 

TL,k = , (21) 

9L,k 



the characteristic leak time of neuron k. We have included the leak reversal potential term in this 
"external" term for convenience. Therefore, even if there is no external current this term is nevertheless 
non zero. 

The sum of the synaptic and external terms gives the deterministic contribution in the membrane 
potential. We note: 

{s, t, uj) = Vi^^") (s, i, uj) + Vi^^*^ (s, uj). 
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Finally, 



L-fc Js L^fc Js 

is a noise term. This is a Gaussian process with mean and variance: 



(22) 



t X 2 

rk{ti,t,uj)dBk{ti) 



(23) 



The square root of this quantity has the dimension of a voltage. 

As a final result, for a fixed uj, the variation of membrane potential during a period of rest (no spike) of 
neuron k between s and t reads (sub-threshold oscillations): 



Vk{t) = rfc(s, t, uj)Vk (s) + (s, w) + Vlf> (s, L^). (24) 

4.2 Reset 

In eq. Q, as in all IF models that we know, the reset of the membrane potential has the effect of removing 
the dependence of Vk on its past since Vk{[t + Tsep ]) is replaced by Vreset- Hence, reset removes the 
dependence in the initial condition Vk{s) in (I24p provided that neuron k fires between s and t in the raster 
uj. As a consequence, eq. (p4|) holds, from the "last reset time" introduced in section [2.10l up to time t. 
Then, eq. reads 

Vk{t) ^vi''''\Tk{t,L^),t,L,) + vi:"''''\Tk{t,io),t,u). (25) 

where: 

V^"°''"^ (Tfe(t, Uj), t, U) = Tkin (t, LO), t, u)Vre.et + ^ (Tfe(t, w), t, C^), (26) 

is a Gaussian process with mean zero and variance: 

aUTk{t,uj),t,Lj)^Tl{Tk{t,w),t,u;)al + (^) f Tlih,t,uj)dh. (27) 

Although the reset condition may look as a simplification it is in fact a source of complications on 
mathematical grounds. As discussed in section [9.31 several proofs are easier if we do not reset memory and 
instead take the limit s — > — oo in (1241) . However, since IF models are widespread in the neuroscience 
literature we have preferred to give the more general proofs and then discuss their adaptation to simpler 
cases. 



5 Useful bounds 

We now prove several bounds used throughout the paper. 
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5.1 Bounds on the conductance 

From ([T^. and since akj {t) > 0: 



= akj {t,Vtn) < akj {t,uj) = ^ akj t - t^p (w) ^ < ^ ak, {t ~ r) = akj {t,Vli) < 

{r;t^.'-'M<t} 



(28) 
Therefore, 

N 

gL,k = gk{tMo) < gk{t,uj) < gk{t,i^i) ^ gm.k < gLM + a^ Gkj, (29) 

so that the conductance is uniformly bounded in t and uj. The minimal conductance is attained when no 
neuron fires ever so that flo is the "lowest conductance state" . On the opposite the maximal conductance 
is reached when all neurons fire all the time so that ili is the "highest conductance state" . To simplify 



notations we note tm k = . This is the minimal relaxation time scale for neuron k while rr i. = is 

' SAf.fc ' gL,k 

the maximal relaxation time. 



TM,k = < TL.k = (30) 

gM,k gL,k 



5.2 Bounds on membrane potential 

Now, from ([T9|) . we have, for s < t: 



0<Tk{s,t,ni)^e <Tk{s,t,uj)<Tk{s,t,no) = e ^^.-^ < 1. (31) 

As a consequence, Tk{s,t,uj) — >■ exponentially fast as s — )• — oo. 
Moreover, 

0< / rk{ti,t,uj)akj{ti,uj)dh<a+ f e~^dh = a+TL,k(l - e~^] <a+TL,k, (32) 



so that: 

a ' ■^-^ , , ,{syn) 



E Wk, < Vt^-^ (s,t,u:)<^J2Wk,. (33) 
Thus, V^'*^"''(s,f,w) is uniformly bounded in s,t. 

Establishing similar bounds for vl.'^^*\s,t,uj) requires the assumption that A < i^k'^^\t) < B, but obtaining 
tighter bounds requires additionally the knowledge of the sign of t^- + and of + . Here, we have 
only to consider that: 
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In this case, 





-1 




TL.k Js 



< 



SO that: 

Consequently: 

Proposition 2 

dcf 



vr'isAco) < \E,\ + 



Tk{ti,t,ijj)dti < 



Er 



9L,k 



TL.k Ck 



1-e < 1^; 



e dti, 



9L,k 



9L,k 



9L,k 



9L,k 



which provides uniform bounds in s,t,uj for the deterministic part of the membrane potential 



9L,k 



(34) 



v,7 '^^^ — J:w,, -(\El\ + —]< vr\s,t,.) < v;+ ^ + \El I + — , (35) 



5.3 Bounds on the noise variance 

Let us now consider the stochastic part V^""**'^'' (rfe(t, oj), w). It has zero mean and its variance ([27|) obeys 
the bounds: 

1-e ] <al{Tk{t,uj),t,uj) 



-2^^^^^ 2 , rM.k (as 



2 VCi 



< e ^^.>' a 



2 , TL,k I Ob 



2 \Ck , 



If (t|, < ^^^^ hand side is an increasing function oi u — t — T-kit^iS) > so that the minimum, 

(tIj is reached for m = while the maximum is reached for u = +oo and is ^^-^^ (^f) ' "^^"^ opposite holds 
if crji > ( ^ ) • "^^"^ same argument holds mutatis mutandis for the right hand side. We set: 



dcf . I O^B TM,k \ I dcf / CTfi TL.k 



(36) 



so that: 

Proposition 3 



< CTj, < (Tk{Tk{t,Uj),t,Uj) < <T^ < +00. 



(37) 



19 



5.4 The limit Tk{t,uj) — > — oo 

For fixed s and t there are infinitely many rasters suclr tliat Tk{t,Lu) < s (we remind tliat rasters are infinite 
sequences). One may argue tliat taking the difference t — s sufficiently large the probability of such 
sequences should vanish. It is indeed possible to show (section [8. ip that this probability vanishes 
exponentially fast with t ~ s, meaning unfortunately that it is positive whatever t — s. So we have to 
consider cases where Tk(t,Lu) can go arbitrary far in past (this is also a key toward an extension of the 
present analysis to more general conductance-based models as discussed in section [9.31) . Therefore, we have 
to check that the quantities introduced in the previous sections are well defined as Tk{t,uj) — > — oo. 
Fix s real. For all lu such that Tk{t,uj) < s - this condition ensuring that k does not fire between s and t - 
we have, from (gS]), ([SI]), < Tk{ti,t,uj)akj (ii,w) < a+ e , Vii G [s,t]. Now, since 
lims_j._oo /g e dti ~ 'TL,k exists, the limit 

1 ^ 

lim vi^^"VT,(i,c.),tc.) = -:^' 



1 ^ /■* 

lim V^'^"^(Tfe(i,cj),t,w) = — y l^fej / rfc(ti,i,cj)afej(ti,cj)dii. 



exists as well. The same holds for the external term V^'^^*''(rfe(i,w),t,cj). 

Finally, since ri.(rfe(<,cj),t,ti;) — > as Tk(t,uj) — > — oo the noise term (j26p becomes in the limit: 

lim v("°^^^'(Tfe(i,c.),i,^) = ^ /* Tk{h,t,uj)dBkih), 

which is a Gaussian process with mean and a variance ^ ) jlao ^fel^i' ^' '^)<^^i which obeys the 
bounds (1571) . 



6 Continuity with respect to a raster. 
6.1 Definition 

Due to the particular structure of gIF models we have seen that the membrane potential at time t is both a 
function of t and of the full sequence of past spikes uj\^}^ . One expects however the dependence with 
respect to the past spikes to decay as those spikes are more distant in the past. This issue is related to a 
notion of continuity with respect to a raster that we now characterize. 

Definition 1 Let m be a positive integer. The m-variation of a function f{t,uj) = /(t,a;L*t|o) 

varm [fit,.)] = sup I I f{t,iv) - fit^uj') | : 1 . (38) 
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where the definition of =^ ' is given in eq. ([5]). Hence, this notion characterizes the maximal variation of 
/(t, .) on the set of spikes identical from time [t] — to to time [t] (cylinder set). It implements the fact 
that one may truncate the spike history to time [t] — m and make an error which is at most varm [fit, ■)]• 

Definition 2 The function f(t,uj) is continuous if var-m [f{t, .)] as m ^ +oo. 

An additional information is provided by the convergence rate to with m. The faster this convergence the 
smaller the error made when replacing an infinite raster by a spike block on a finite time horizon. 



6.2 Continuity of conductances 

Proposition 4 The conductance gk {t,uj) is continuous in lo, for all t, for all k = 1 . . . N . 
Proof Fix = 1 . . . TV, t e R, TO > integer. We have, for uj ™=*' w': 



\akj - akj{t,uj')\ = 



E 



{r;t('-)M<t} 



a,,(<-tMH) - a,, [t - tl^'\u:')) 



{ r' ;t^''''(w')<t-m} 



are identical by hypothesis. 



since the set of firing times 1 1 — to < t'j'\uj) <t|, |t — m< t^" ''(w') < ^ | 
So, since akj (x) > 0, 

\akj {t,uj) - akj {t,uj')\ 
<2 Y ak,{t-r). 

r<t — 'm 

Therefore, as m — > +oo, from ([T2|) and setting M = t — m, : 



var„ 



[akj {t,.)]<2 J2 akj{t-r) ^2 Pa[ — ] e , 



r<M 



which converges to as to — +oo. 

Therefore, from ()17p gk {t,Lu) is continuous with a variation 



var,n [fffc (t, . )] ^ 2 ^ Gkj Pd [ — ) e'~ , 



which converges exponentially fast to as to — >■ +oo. 
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6.3 Continuity of the membrane potentials 

Proposition 5 The deterministic part of the membrane potential, vjf'^*'\Tk(t,Lu),t,Uj), is continuous and 
its m-variation decays exponentially fast with m. 

Proof In the proof, we shall establish precise upper bounds for the variation of vjf^"\Tk{t, .),<, .), 
V^.'^^*'' {Tk{t, .), t, .) since they are used later on for the proof of uniqueness of a Gibbs measure (section 
I7.4.ip . From the previous result it is easy to show that, for all w = ' oj', ti < t2 < t: 



\Tk{tiM.^) - rfc(ii,<2,w')l < Tk{tiM.^) 



'"1 gfc It . s 



Therefore, from (|3T 



var.m[rk{ti,t2,.)]<e ^^-^ f e^^^*^ 



- 1 



and Tk{ti,t2,io) is continuous in uj. 

Now the product Tk {ti,t2,uj) akj ( ti , oj ) is continuous as a product of continuous functions. Moreover: 
varm [rfe(ti,i2, ■)akj (ti, • )] < sup Tk{ti,t2,uj) var^n [akj (ti, . )] + sup akj {ti,uj)varm \^k{ti,t2, ■)] 



var„i [akj {ti,.)] + I e 



1 ) akj { ti,Q.i ) 



so that: 



varm [rfe(ti,t2, ■)akj {ti, ■)] < e 
Since, as m — > +oo: 



2Pd\ — I e 

Tkj 



e "^fc 



- 1 ^ p; (i2 - tij 



2(t2-ii) 



N 



we have, 



varm [rfc(ii,i2, O^fcj (ii, . )] ^ 2e "^■'^ 



which converges to as m — > +oo. 

Let us show the continuity of V^*^"''(Tfe(t, .). We have, from (|20p . 



(syn) I 
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7 = 1 



N 



J Tk(t,U>) 

The following inequality is used at 
have: 



Tu{ti,t,uj)akj{ti,u:)dti- I T},{ti,t,uj')akj {ti,uj' ) dti 
several places in the paper. For a ti-integrable function f(ti,t,io), we 



f{h,t,u)dtl- / f{tl,t,Lu')dt 



< f \f{h,t,UJ-f{h,t,Uj')\dh + 



f{tl,t,L0')dtl 

(39) 



Here it gives, for ti < t: 



Tk{ti,t,uj)akj {ti,uj)dti - / Tk{ti,t,uj')akj {ti,uj')dt 

'Tkit.Uj') 



< 



I \Tk{ti,t,uj)akj{ti,uj)-Tu(ti,t,uj')akj{ti,uj')\dti+ / Tk{ti,t,uj')akj {ti,uj' ) dt 



For the first term, we have. 



< / varjn 

J Tk{t,U]) 
J — OO 



I Tk{ti,t,uj)ak] {ti,uj) - Tk{ti,t,uj')akj (ii, ) | dti 
[Tk{ti,t,.)akj {ti,.)]dti < / varjn[Tk{ti,t,.)akj {ti,.)]dti 

•J —OO 



, a+{t-ti 



N 



m 



= 2Pj — ] e "<^^ 



Pd{ — ] e + -^r^ V Gkf Pd , 

Tkj J Ofc V Tkj 

N 



1 ~^TT 
e ''J 



e ^L-^dti + / 



^ Gfcj- Pd ^ j e"^ y - ti) e'^dti, 



= 2TL,k 



V '^kj J Ofe V Tkf ) 

Let us now consider the second term. If Tk(t,io) > t — m or Tk(t,Lu') >t — m, then Tk{t,Lu) = Tk(t,Lu') and 



this term vanishes. Therefore, the supremum in the definition of var 
Tk{t, uj) < t — m and Tk{t, uj') < t 

l'Tk{t,Uj') 



m. 



Then, from 



vjf^^\Tk{t, .) is attained if 
We may assume, without loss of generality, that Tk{t,u)') > Tk{t,uj). 



JTk(t,Lj) 

t-Tk(t,Uj') 



Tk{ti,t,uj')akj {ti,uj' ) dti < 



+ / e ^i-^dti 



1 - e 



' 'rk{t,iJ) 



So, we have, for the variation of V^^^"^ {Tk{t, ■),t, .), using ([2T 



fvi'""^(rfe(i,.),t,.) 
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so that finally, 



with 



var„ 



N . s 



fli.fe \ 9L,k jTT^ / 



and varn 



vjf^"^^ {Tk{t, .),t, .) converges to exponentially fast as m ^ +00. 
Now, let us show the continuity of vjf''*\Tk{t,u)),t,oj) with respect to oj. We have: 

Vf^ {Tk {t, Uj),t,Oj)- Vf^ (Tfc {t, UJ'), t, J) 



(40) 

(41) 
(42) 



JTk(t,w) \ TL,k 



Ck 



rk(ti,t,uj) dti 



f {- 



El , it'\ti) 



< 



Tfe(t,w) 



El . *r^(ti) 



TL,k 



Ck 



\Tk{ti,t,iv) - Tk{ti,t,u}') I dti + 



Ck 



TL,k 



C 



Tk{ti,t,uj')dti 

Tkiti,t,uj')dti 



< 



\El\ ^ 

TL,k Ci 

El\ , i 



+ \ / /-t fTkit,U>') 

- / \Tkih,t,Lj)-Tk{h,t,u')\dh+ Tk{tut,u')dh 

^k J \JTk(tM) JTk(t,Uj) 



< 



TL,k Ck 



varm [Tk{ti,t,.)] dti + 



Tk{t,U]') t-ti 

e "J^.'= dti 



+ \ 2t 



2 N 
L,k 



m 

Tkj' 



TL,k Ck J \ Ck 

where, in the last inequality, we have used that the supremum in the variation is attained for 
rfe(t, ijS) <t — m and Tfe(t, w') <t — m. Finally: 



varr, 



Vt'\rk{t,.),t,.)] ^J247'^ P'^i^^ 



where. 



j(ext) _ Q ^fcj p(ea;t) 



gL,k 



9L,k 



(43) 

(44) 
(45) 



and vl^^*\Tk{t, .),t, .) is continuous. 

As a conclusion, vjf''*\Tk{t, .),t, .) is continuous as the sum of two continuous functions. 
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6.4 Continuity of the variance of v{"°**'^^(Tfc(t, .) 
Using the same type of arguments one can also prove that 



Proposition 6 The variance ai^(Tf^(t,Lu),t,u!) is continuous in uj, for all t, for all k = I . . . N . 



Proof We have, from ^7} 



a%var„r[rl{Tkit,.),t,.)] + 



Tl{ti,t,uj)dh 



Tl{h,t,cj')dh 



For the first term we have that the sup in varm [r^(Tfe(t, .)] is attained for Tk{t,uj),Tk{t,uj') <t — m 
and: 

var^ [Tl{Tk{t,.),t,.)] < 2sup{Tl{Tk{t,uj),t,u); us.t.Tk{t,uj) < t - m} < 2e~^ . 



For the second term we have: 



t 

Tl{ti,t,uj)dti^ / Tl{ti,t,uj')dti 



< / I r^(ii, c^) - ^lih^t, w') I rfti + / ' ^ ^l{ti,t, w') dh 

</ var„^[^l{tl,t,.)] dti+ e dh 

JTkit.Uj) JTk{t,Uj) 



2(t - ti) 

< / e "^- '^ 

-oo 



i[afc(*>- ) (t-ti)] 



- 1 ] dti 



TL.k 



'L,k 

2 Cjfc 



varm [gk (t,.)] 



2 



so that finally: 



with 



N 



var„i 



Tfci 



A 



kj 



9L,k 



Ck 



1 f CTb y^TL,k 
Ck 



24, 



(46) 



and continuity follows. 
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6.5 Remark 

Note that the variation of all quantities considered here is exponentially decaying with a time constant 
given by niax(rfej, Ti^fe). This is physically satisfactory: the loss of memory in the system is controlled by 
the leak time and the decay of the post-synaptic potential. 

7 Statistics of raster plots. 

7.1 Conditional probability distribution of Vk{t). 

Recall that P is the joint distribution of the noise and E [ ] the expectation under P. Under P the 
membrane potential F is a stochastic process whose evolution, below the threshold, is given eq. ([M]). (I^5|) 
and above by It follows from the previous analysis that: 

Proposition 7 Conditionally to wL'jo; ^(^) Gaussian with mean: 



E 



Vk (t) I J_!l\ = V*''^*) {T,{t,u;),t,u), k^l...N, 



ana covariance: 



Gov 



Vk{t)Mt)\^-l\ ^<jl{Tk{t,uj),t,uj)Ski, k,l = l...N 



where al{Tk{t,uj),t,Lu) is given by \27^ . 

Moreover, the Vk{t) 's, k = 1 . . . N , are conditionally independent. 

Proof Essentially, the proof is a direct consequence of eq. ([M)) . (|25p and the Gaussian nature of the noise 
V^,""^^'' (Tfc(t, a;), t, cj). The conditional independence results from the fact that: 



Gov 



v^{t),Vi{t)W^-l 



Gk Gi 



Tk{ti,t,uj)dBk{ti) / Ti{t2,t,uj)dBi{t2)\io 



+ Gov[Tk{Tk{t,Uj),t,Uj) Vreset, T; (t; , w) , t , 



/ / Tkiti,t,Lu)Ti{t2,t,uj)E[dBk{ti)dBi{t2)] + alTl{Tk{t,u),t,Lj)dki 



Okl 



Gt 



2 „t 



Tk{ti,t,uj)Tk{t2,t,uj)d{ti - t2)dtidt2 + a-j^ T^.{Tk{t,uj),t,uj) 



= (yliTk{t,uj),t,uj)Ski. 
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7.2 The transition probability. 

We now compute the probability of a spiking pattern at time n = [t], uj{n), given the past sequence w""^ 



oo 



Proposition 8 The probability of uj{n) conditionally to to'^^ is given by: 



N 

P[u;in) \ u;--J]=l[P[Mn) \u;-'J] , (47) 
fc=i 

with 

P[ujkin) luj^l^] ^uJk{n)Tr{Xk{n-l,u)) + il-iJk{n)) (1 - ^ (Xfe(n - 1, w))) , (48) 

where 

X (n ^u.)- (^-Vi'"\r,{n-l,u.U-l,u;) 

Xk(n~l,uj) - — , (49) 

crk{Tk{n - l,w),n - l,w) 



an I 



d 



+ 00 

2tt Jx 



Tr{x) = — ^ / e "2 du. (50) 



Proof We have, using the conditional independence of the Vfe(n)'s: 



N 



P [u{n) I u^-J] = n (ujkin) P[Vk{n-l)>9\ u^'J] + (1 - ^..(n)) P [Vk{n - 1) < 9 \lo-_-J]) . 
fe=i 

Since the Vk{n — l)'s are conditionally Gaussian, with mean V^''^*'' (rfc (n — 1, lu), n ~ 1,uj) and variance 
crl{Tk{n ~ l,Lu),n - l,Lu) we directly obtain (|T7)) . p5t . 

Note that since <7k{Tk{n — l,uj),n~ l,w) is bounded from below by a positive quantity (see p7l) ) the ratio 



<^k{rkin—l,uj),n—l,uj) 



7.3 Chains with complete connections 

The transition probabilities (j47l) define a stochastic process on the set of raster plots where the underlying 
membrane potential dynamics is summarized in the terms vjf'^*'\Tk{n — l,cj),n— l,uj) and 
^k{Tk{n — l,a;),n — l,a;). While the integral defining these terms extends from Tfc(n — l,a;) to n — 1 where 
Tk{n — Ijw) can go arbitrary far in the past, the integrand involves the conductance gk{n— 1, w) which 
summarizes an history dating back to s = —oo. As a consequence, the probability transitions generate a 
stochastic process with unbounded memory, thus non Markovian. One may argue that this property is a 
result of our procedure of taking the initial condition in a infinite past s — > — cx), to remove the unresolved 
dependency on gk{s) (section [3.4p . So the alternative is either to keep s finite in order to have a Markovian 
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process; then we have to fix arbitrarily gk{s) and the probability distribution of Vk{s). Or we take 
s — >■ — cx), removing the initial condition, to the price of considering a non Markovian process. Actually, 
such processes are widely studied in the literature under the name of "chains with complete 
connections" [47 l[50l - l53] and several important results can be used here. So we adopt the second approach 
of the alternative. As a by-product the knowledge of the Gibbs measure provided by this analysis allows a 
posteriori to fix the probability distribution of Vk{s). 

For the sake of completeness we give here the definition of a chain with complete connections (see ^[^ fo^' 
more details). For n e Z, we note -4"^ the set of sequences uj"'^ and J-<n-i the related cr-algebra, while 
T is the CT-algebra related with X = A^. V{X,F) is the set of probability measures on {X^F). 

Definition 3 A system of transition probabilities is a family { Pn }„g^ of functions 

P„[ I ]:AxAl-^^[0,l], 

such that the following conditions hold for every n G Z; 

• For every u!{n) e A the function Pn [uj{n) \ ■] is measurable with respect to J-<n-i- 

• For every & A"r^ , 

^ P„[c.(n) |c.!!-i] =1. 

u:{n)eA 

A probability measure fj, in V{X,J-) is consistent with a system of transition probabilities { P„ if for 

all n TL and all J- <cn -measurable functions f : 




Such a measure fi is called a "chain with complete connections consistent with the system of transition 
probabilities { Pn "■ 

The transitions probabilities (H71) constitute such a system of transitions probabilities: the summation to 1 
is obvious while the measurability follows from the continuity of P„ | w"^^] proved below. To 

simplify notations we write p{n,uj) instead of P„ ['^('t-) | '^"^^j whenever it makes no confusion. 

7.4 Existence of a consistent probability measure fi 

In the definition above, the measure fj, summarizes the statistics of spike trains from — oo to +oo. Its 
marginals allow the characterization of finite spike blocks. So, /x provides the characterization of spike train 
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statistics in gIF models. Its existence is established by a standard result in the frame of chains with 
complete connections stating that a system of continuous transition probabilities on a compact space has 
at least one probability measure consistent with it |47j . Since tt is a continuous function the continuity of 
p(n,LL>) with respect to lu follows from the continuity of V^'*'^*'' (r^ (n — l,w),n — l,a;) and the continuity of 
o'fc(Tfc(ri— l,a;),n— l,w), proved in section [6l 

Therefore there is at least one probability measure consistent with (|47p . 
7.4.1 The Gibbs distribution. 

A system of transition probabilities is non-null if for all n e Z and all uj"l^ G -4-^; P ['^(") | "^"m^] > 0- 
Following _54 , a chain with complete connection /i is a Gibbs measure consistent with the system of 
transition probabilities p{n, .) if this system is continuous and non-null. Gibbs distributions play an 
important role in statistical physics, as well as ergodic theory and stochastic processes. In statistical 
physics they are usually derived from the maximal entropy principle |15| . Here we use them in a more 
general context affording to consider non-stationary processes. It turns out that the spike train statistics in 
gIF model is given by such a Gibbs measure. In this section we prove the main mathematical result of this 
paper (uniqueness of the Gibbs measure). The consequences for spike trains characterizations are discussed 
in the next section. 

Theorem 1 For each choice of parameters 7 G "H the gIF model il6]) has a unique Gibbs distribution. 
The proof of uniqueness is based on the following criteria due to Fernandez and Maillard |54| . 
Proposition 9 Let: 

m(p) = inf inf p{n,uj), 

and^ 

v{p) = sup varn-m' [p{n, .) ] . 

n>m' 

If m(j>) > and v{p) < 00, then there exists at most one Gibbs measure consistent with it . 
So, to prove the uniqueness we only have to establish that 

m{p) > 0, (51) 



^In | 54| the authors use the following definition for the n, m variation, which reads in our notations: 

var'^ [p(n,.)] = sup { | p(n, i^) -p{n,uj') \ ; aj,w' e A":^,uj'^ = ^^m} : m<n. 

It differs therefore slightly from our definition JSJ , GHJ • The correspondence is var'^ [p(™, •) ] = 'i'l^n-m [p('^, ■) ]• The definition 
of v{p) takes this correspondence into account. 
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v{p) < +00. 



(52) 



Proof 

m{p) > 0. 
Recall that: 



N 



p{n,uj) = [uJk{n)-K{Xu{n-l,uj)) + (1 - Wfc(n)) ( 1 - tt ( Xfe(n - 1, cj) ) ) ] 
fc=i 

From (IMl), dSll) we have: 



00 < 



k 



< Xk{n - 1,0;) < 



0-Vr 



< +00. 



Since tt, given by (|50p . is monotonously decreasing, we have: 



so that: 



Finally, 



< TT^, = TT ' 



< n^. =^ min ( TTj, , 1 - TT^ ) < i:jfc(n) TT^ + ( 1 - Wfc(n) ) ( 1 - tt^ ) <pk{n,uj) 



dcf 



< TT (Xfe(n - 1, w) ) < TrjT = TT 



- V,1 



< 1, 



< Wfc(n) 7r+ + ( 1 - Wfe(n) ) ( 1 - TTj^ ) < n+ max ( 7r+, 1 - tt^ ) < 1 



TV 



^(p) > n > 0, 



fe=i 



which proves ()5ip . This also proves the non-nuUness of the system of transition probabilities. 
v{p) < 00. 

The proof, which is rather long, is given in the appendix. 



(53) 



(54) 



8 Consequences 

8.1 The probability that neuron k does not fire in the time interval [s,t] 



In section [4.21 we argued that that this probability vanishes exponentially fast with t ~ s. This probability 



IS fl 



nLl[.]+i{^;c(n)=0} 



. We now prove this result. 



Proposition 10 The probability that neuron k does not fire within the time interval [s,t], t — s> 1, has 
the following bounds: 



[*] 



fl {uk{n)^0} 



<n[*i-[^i <i. 



_ri=[s] + l 

for some constants < n_ < 11+ < 1 depending on the system parameters j & H. 
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Proof We have: 



[*] 

n=[s] + l 



It] 

fl {c.fe(n) = 0} 

n=[s] + l 



dii{uj) 



/^^ n ^,[{uJ,{n)^o}\uJTJ]d^,iLo) 

•^•^-oo n=[s] + l 

r 



-3o n—[ s 1 + 1 



where P [a;fe(n) =0 | a;"^^^] is given by (H7|) and obeys the bounds ([5i]). Therefore, setting n_ = nfc=i 
and n+ =111^1 , we have 



8.2 Back to spike trains analysis with the maximal entropy principle 

Here we shortly develop the consequences of our results in relation with the statistical model estimation 
discussed in the introduction. A more detailed discussion will be published elsewhere (in preparation 
and [5S]). Set: 

AT 

(j>{n,uj) ^ \ogp{n,uj) ^^(t)k{n,uj) , (55) 

fc=i 

with, 

(/)fc(n,w) =^Wfc(ri) log7r(Xfc(n- l,w)) + (l-Wfe(n)) log ( 1 - tt ( - l,w))). (56) 

The function is a Gibbs potential [56j. Indeed, we have Vm < n, \/uj"^: 

n 

=exp5^0(/,c.). 

l—m 

This equation emphasizes the connection with Gibbs distributions in statistical physics which considers 
probability distributions on multidimensional lattices with specified boundary conditions and their 
behavior under space translations |56) . The correspondence with our case is that "time" is represented by a 
mono-dimensional space and where the "boundary conditions" are the past uj"^^^. Note that in our case 
the partition function is equal to 1. 

For simplicity assume stationarity (this is equivalent to assuming a time-independent external current). In 
this case, it is sufficient to consider the potential at time n = 0. 
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Thanks to the bounds (|53p one can make a series expansion of the functions log ( tt ) and log ( 1 — tt ) and 
rewrite the potential under the form of the expansion: 

+00 R 

(t>{Q,^) = ^^ X! \k^,n^),...,{K,7i^)^k,(ni)---^K{'n'r) (57) 

_R=1 r=l { (fei,rii),...:(fcr,nr)e'P(A^,-R) } 

where V{N^ R) is the set of non-repeated pairs of integers (fc, N) with fee { 1, . . . , iV } and 
71 G { — i?, . . . , }. We call the product LOk-^ (rii) . . . LJk^{nr) a monomial. It is 1 if and only if neuron ki fires 
at time rii, . . . , fires at time 71^. The Ajfc^ „j)^ (^.^ „^)'s are explicit functions of the parameters 7. Due 
to the causal form of the potential, where the time-0 spike, Wfc(O), is multiplied by a function of the past 
wZ^, the polynomial expansion does not contain monomials of the form ajfcj(O) . . .CLifc^(O), r > 1 (the 
corresponding coefficient A vanishes). 

Since the potential has infinite range the expansion (j57p contains infinitely many terms. One can 
nevertheless consider truncations to a range R = D + 1 corresponding to truncating the memory of the 
process to some memory depth D. Note that although truncations with a memory depth D are 
approximations, the distance with the exact potential converges exponentially fast to as Z? — > +00 thanks 
to the continuity of the potential, with a decay rate controlled by synaptic responses and leak rate. 
The truncated Gibbs potential has the form: 

=5:A,0,(..°^); (58) 
I 

where I stands for (fci, rii), . . . , (fc^, rir) and is an enumeration of the elements in V{N, D + 1) and where 
is the corresponding monomial. Due to the truncation (j58p . contrarily to (I55|) . is not normalized. Its 
partition functioij^ is not equal to 1 and its computation becomes rapidly intractable as soon as the 
number of neurons and memory depth increases. 

Clearly, (j58p is precisely the form of potential which is obtained under the maximal entropy principle, 
where the 4>i 's are constraints of type "neuron ki is firing at time ni, neuron k2 is firing at time n2, ... " 
and the A; 's the conjugated Lagrange multipliers. Thus, using the maximal entropy principle to characterize 
spike statistics in the gIF model by expressing constraints in terms of spike events (monomials), one can at 
best find an approximation which can be rather bad, especially if those constraints focus on instantaneous 
spike patterns {D ~ 0) or short memory patterns. Moreover, increasing the memory depth to approach 

"3 For D > this is Z{uiZo) = Euj(O) '-'^-o), ensuring that _i ° — is a conditional probability P ijj(O) ■ 

Hence it is not a constant but a function of the past i^Z^i in ^ similar way to statistical physics on lattices where the partition 
function depends on the boundary conditions. Only in the case D = (memory less) is this a constant. 
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better the right statistics leads to an exponential increase in the number of monomials which becomes 
rapidly intractable. Finally, the Lagrange multipliers A; are rather difficult to interpret. 
On the opposite, the analytic form (1551) depends only on a finite numbers of parameters (7) constraining 
the neural network dynamics, which have a straightforward interpretations being physical quantities. This 
shows that, at least in gIF model, the linear Gibbs potential ([58]) obtained from the maximal entropy 
principle is not really appropriate, even for empirical/numerical purposes, and that a form (j55p where the 
infinite memory is replaced by ujZ}) could be more efficient although nonlinear. 
To finish this section let us discuss the link with Ising model in light of the present work. Ising model 
corresponds to a memory-less case, hence to D = 0. Since the causal structure of the Gibbs potential 
forbids monomials of the form uJk^ (0) . . . ajfe^(O), the D — expansion of the gIF-Gibbs potential 
corresponds to a Bernoulli distribution where neurons are independent (j)^'^^ (0,w) — X^s^i ^k^-^ki^)- The 
Ising model is therefore irrelevant to approximate the exact potential of gIF model, if one wants to 
reproduce spike statistics at the minimal discretisation time scale S without considering memory effects. 
However, in real data analysis people are usually binning data, with a time windows of width it; ^ 10 — 20 
ms. Binning consists of recoding the raster plot with spikes amalgamation. The binned raster b consists of 
"spikes" bk{n) e {0, 1 } where bk{n) = 1 if neuron k fired at least once in the time window [nw, {n + l)w[. 
In the expansion (|57[) this corresponds to collecting all monomials corresponding to bk (n) = 1 in a unique 
monomial. In this way, the binned potential contains indeed an Ising term . . . that mixes all spike events 
occurring within the time interval w. These events appear simultaneous because of binning, leading to the 
Ising pairwise term bk^ iO)bk2 (0) while events occurring on smaller time scales are scrambled by this 
procedure. 

The binning effect on Gibbs potential requires however a more detailed description. This will be discussed 
elsewhere. 

9 Discussion. 

To conclude this paper we would like to discuss several consequences and possible extensions of this work. 
9.1 The spike time discretisation 

In gIF model membrane potential evolves continuously while conductance are updated with spike 
occurrence considered as discrete events. Here we discuss this time discretisation. Actually, there are two 
distinct questions. 
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9.1.1 The limit of time- bin tending to 

This limit would correspond to a case where spike is instantaneous and modeled by a Dirac distribution. 
As discussed in |32| this limit raises serious difficulties. To summarize, in real neurons firing occurs within 
a finite time S corresponding to the time of raise and fall for the membrane potential. This involves 
physico-chemical processes which cannot be instantaneous. The time curse of the membrane potential 
during the spike is described by differential equations, like Hodgkin-Huxley's [3S]. Although, the time scale 
dt appearing in the differential equations has the mathematical meaning of being arbitrary small, on 
biophysical grounds this time scale cannot be arbitrary small, otherwise the Hodgkin-Huxley equations 
loose their meaning. Indeed, they correspond to an average over microscopic phenomena such as ionic 
channels dynamics. In particular, their time scale must be sufficiently large to ensure that the description 
of ionic channels dynamics (opening and closing) in terms of probabilities is valid so dt must be larger than 
the characteristic time of opening-closing of ionic channels rp. Additionally, Hodgkin-Huxley's equations 
uses a Markovian approach (master equation) for the dynamics of h, m, n gates. This requires that the 
characteristic time dt is quite a bit larger than the characteristic time of decay for the time correlations 
between gates activity tc- Summarizing, we must have < tc,tp < dt < 5. Thus, on biophysical grounds 
S cannot be arbitrary small. 

In our case, the 5 — ?■ limit is armless however, provided we keep a non zero refractory period, ensuring 
that only finitely many spikes occur in a finite time interval. Taking the limit 5 — )• without considering a 
refractory period raises mathematical problems. One can in principle have uncountably many spikes in a 
finite time interval leading to the divergence of physical quantities like energy. Also, one can generate nice 
causal paradoxes |43) . Take a loop with two neurons one excitatory and one inhibitory and assume 
instantaneous propagation (the a profile is then represented by a Dirac distribution). Then, depending on 
the synaptic weights value one can have a situation where neuron 1 fires instantaneously, and make 
instantaneously 2 firing which prevents instantaneously 1 from firing and so on. So taking the limit (5 — > 
as well as Trefr induces pathologies not inherent to our approach but to IF models. 

9.1.2 Synchronisation for distinct neurons. 

There is a more subtle issue pointed out in f57|. We do not only discretize time for each neuron' spikes, we 
align the spikes emitted by distinct neurons on a discrete time grid, as an experimental raster does. As 
shown in [32 this induces, in gIF models with a purely deterministic dynamics (no noise and reset to a 
constant value), an artificial synchronisation. As a consequence the deterministic dynamics of gIF models 
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has generically only stable periodic orbits, although periods can be larger than any accessible 
computational time in a specific region of the parameters space. Additionally, these periods increase as S 
decreases. The addition of noise on dynamics and on the reset value, as we propose in this paper, removes 
this synchronization effect. 

9.2 Refractory period 

In the definition of the model we have assumed that the refractory period T,.e/ was smaller than 1. The 
consequence for raster plots is that one can have two consecutive I's in the spike sequence of a neuron. The 
extension to the case where r^e/ > 1 is straightforward for spike statistics. Having such a refractory period 
forbids some sequences. For example if 1 < r,.e/ < 2 then all sequences containing two consecutive I's for 
one neuron (1, 1) are forbidden. If 2 < r^e/ < 3 sequences containing 1, 1 for a given neuron, where 
* = 0, 1, are forbidden, and so on. More generally, the procedure consisting of forbidding specific (finite) 
spike blocks is equivalent to introducing a grammar in the spike generation. This grammar can be 
implemented in the Gibbs potential: forbidden sequences have a potential equal to ~oo (resp. a zero 
probability). In this case, X = A^, the set of all possible rasters, becomes a subset where forbidden 
sequences have been removed. 

9.3 Beyond IF models 

Let us now discuss the extension of the present work to more general models of neurons. First, one 
characteristic feature of Integrate-and-Fire models is the reset which has the consequence that the memory 
of activity preceding the spike is lost after reset. Although in the deterministic (noiseless) case this is a 
simplifying feature allowing for example to fully characterize the asymptotic dynamics of (discrete-time) IF 
models |321I59| . here it somewhat renders more complex the analysis. Indeed, it led us to introduce the 
notion of "last reset" time and, at some point in the proof (see e.g. eq. ([5^ ). obliged us to consider several 
situations (e.g. Tk{t, uj) > t ^ m or Tk{t, u') > t — m versus Tk{t, uj) < t — m and Tk{t, uj') < t — m h\ the 
proof of continuity, section [5]). On the opposite, considering a model where no such reset occur would 
simply lead us to consider a model where Tk{t,uj) — > — cx), VtJ,Vfc. This case is already considered in our 
formalism, and actually, considering that Tk{t,uj) — ;> — cxd, ^uj^yk simplifies the proofs (for example it 
eliminates the second term in eq. (HH])). 

As a matter of fact, the theorems established in this paper should therefore also hold without reset. But 
this requires to replace the firing condition Q by another condition stating what the membrane potential 
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does during the spike. Although, it could be possible to propose an ad hoc form for the spike, it would 
certainly be more interesting to extend the results here to models where neurons activity depends on 
additional variables such as adaptation currents, as in the FitzHugh-Nagumo model [35113711151115] i or 
activation-inactivation variables as in the Hodgkin-Huxley model |35j . 

The present formalism affords an extension toward such models, where the neuron fires whenever its 
membrane potential belongs to a region of the phase space, which can be delimited by membrane 
potentials plus additional variables such as adaptation currents or activation-inactivation variables, and 
where the spike is controlled by the global dynamics of all these variables. But, while here the firing of a 
neuron is described by the crossing of a fixed threshold, in the FitzHugh-Nagumo model it is given by the 
crossing of a separatrix in the plane (voltage-adaptation current), and by a more complex "frontier" in the 
Hodgkin-Huxley model [3l|38]. One difficulty is to precisely define this region. To our knowledge there is no 
clear agreement for the Hodgkin-Huxley model (some authors [3; even suggest that the "spike region" 
could have a fractal frontier). The extension toward FitzHugh-Nagumo seems more manageable. 
Finally, the most important difficulty toward extending this paper results to more realistic neural networks 
is the definition of the synaptic spike response. In IF models the spike is thought as a punctual "event" 
(typically, an "instantaneous" pulse) while the synaptic response is described by a convolution kernel (the 
a-profile). This leads one to consider a somewhat artificial mixed dynamics where membrane potential 
evolves continuously while spike are discrete events. In more realistic models, one would have to consider 
kinetic equations for neurotransmitter release, receptor binding and opening of post-synaptic ionic 
channels [51115]. Additionally, the consideration of these mechanics deserves a spatially extended modelling 
of the neuron, with time delays. In this case, all variables evolve continuously and the statistics of spike 
trains would be characterized by the statistics of return times in the "spike region" . This statistics is 
induced by some probability measure in the phase space; a natural candidate would be the 
Sinai- Ruelle-Bowen measure [60H62j . for stationary dynamics, or the time-dependent SRB measure for 
non-stationary cases, as defined e.g. in [53]. These measures are Gibbs measures as well [M]. Here, the 
main mathematical property ensuring existence and uniqueness of such a measure would be uniform 
hyperbolicity. To our knowledge conditions ensuring such a property in networks has not been established 
yet neither for Hodgkin-Huxley's nor for FitzHugh-Nagumo's models. 
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9.4 Synaptic plasticity 

As the results established in this paper hold for any synaptic weight value in they hold as well for 
networks underlying synaptic plasticity mechanisms. The effects of a joint evolution of spikes dynamics, 
depending on synaptic weights distributions, and synaptic weights evolution depending on spike dynamics 
has been studied in |65) . In particular it has been shown that mechanisms such as Spike-Time Dependent 
Plasticity are related to a variational principle for a quantity, the topological pressure, derived for the 
thermodynamic formalism of Gibbs distributions. In the paper i65, the fact that spike trains statistics were 
given by a Gibbs distribution was a working assumption. Therefore, the present work establish a firm 
ground for |65j . 
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10 Appendix 

Here we establish ([5^ . We use the following lemma. 

Lemma 1 For a collection < Ofc, a'fe < 1, Vfc = 1 . . . N , we have 



N 



N 



N 




(59) 



This lemma is easily proved by recursion. 



We have, for n e m > 




where: 



ujkin)^ {Xk{n - ) + ( 1 



ujk{n) ) ( 1 



TT{Xk{n 



a;^(n)7r ( Xk{n — 1, w') ) + ( 1 



TT{Xk{n 



1,^')))- 



Therefore, using inequality ([5^. 
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N 

[pin, .)] < X! ™P { I ^ "fc I ^ 



fc=i 



The condition lu lu' implies Wfc(n) = so that: 



lafc-a'fcl = k(Xfc(n-l,w))-7r(Xfc(n-l,w'))l• 



We have 

I TT{Xk{n - 1, u)) - 7r(Xfe(n - 1, w')) I < I ^fc(" - 1, w) - Xfc(7i - 1, w') | ||7r'||oo, 
with IItt'IIoo = sup^gj^ I 7r'{x) \ = -=, so that 



var,n 



1 ^ 

[p{n, .)] < ^= var.n [Xk{n - 1, .)] 
y 2tt , , 



We have now to upper bound varm [Xk{n — 1, .)] = sup | | Xk{n — 1, w) — Xk{n — 1, w') | ; uj ^ '^'}- 
have 



mr„i - 1, .)] < var„i 9 - vjf''*\Tk{n - 1, .),n- 1, .) 



+ sup 

with, 

varjn 
< var,, 

so that, from gOl), (l43 



vf^*^(Tfe(n-l,c.),n-l,c.) 



1 

sup r 

^<zx (Tk[Tk[n- l,ui),n- l,uj) 
1 



-Vf*)(rfe(n-l,.),n-l,.) 
V(^^"'(rfe(n-l,.),n-l,.) 



varm 



_ak{Tk{n - 1, .), n-l,.) 



Vr*'(Tfe(n-l,.),n-l,.)' 
Vt'\rk{n-l,.),n-l,.) 



N 



vavm 



Vr)(r,(n-l,.),n~l,.)J^E4r^47^ 



e ''J + Bj, e ^-.'^ 



where: 



(see eq. (|4T]),(j4l|) and: 

(see eq. P^ . (|i5|) ). 
Moreover, from ([ST)) . 



.(det) _ Asyn) Aext) 
^kj — ^kj + ^kj ' 



„(dei) _ r>{syn) r>{ext) 



1 1 
sup r r < 

ujex o-k[Tk{n- l,uj),n- l,u}) cr^ 



(60) 



(61) 
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From (1551) . 



Finally, 



sup 



vi'''*^(Tfc(n - 1, cj), n - 1, w) < max ( I - y- I , I - y+ 



vavm 



1 



(Tk{Tk{n - 1, .),"-- 1, •) 



< uar,„ [crfe(TA;(n - 1, .),n - 1, .)] sup — r— 



while 



< -jvarm [(JkiTkin- l,.),n- 1,.)] 



varm [crl{Tk{n- l,.),n- 1,.)] > 2 CT;, var^ [crfc(Tfc(n- l,.),n~ 1,.)] 



from ((37)) . so that: 



varjn [(Jk{Tk{n - 1, .),"-- 1, •)] < TT"^ WUTk{n - 1, ■)>"-- I7 •)] 1 



and, from (|46 



_ak{Tk{n - 1, .),"-- 1, •) 
Summarizing (pT|) . 



-< 



varm 



max 



[\(^-Vk-\,\9-V+ 



N 



TO 



e + C'^> e 



Thcrefore, we have: 



vaTn 



\X.{n-l..)]<j:AifpJ^) 



e + Bf^ e + e 



for constants A^;^^ , b[^^ , C^^^ . 
As a consequence, 



TV 



?;ar„ [p{n, .)] ^ — i= V 



Therefore, J2n>m' "^^fl^n-m' •) ] is bounded from above by the series 



N 

E 

fc=i 



TV 



J — 1 ri>m' 
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1 ^ 

/27 



fc=i 



N 

i=l i>0 



J>0 



i>0 



which converges, uniformly in m! . As a consequence, in (|52p . < +00 and we are done. 
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Figures 

Figure [1]- Time course of the membrane potential in our model. The blue dashed curve illustrates the 
shape of a real spike, but what we model is the red curve. 
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